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INTROOUCTIOW 


An  • £  £  opt  is  currently  underway  which  will  upgrade  the 
F/FB/EF-111  aircraft  through  the  introduction  of  a  digital  flight 
control  system  (DFCS) .  An  added  safety  of  flight  capability 
planned  for  inclusion  into  this  modification  is  a  voice  message 
generation  system.  This  system  will  be  used  as  a  primary  means 
of  alerting  the  operators  to  flight  critical,  terrain  following 
radar,  and  ground  proximity  warnings.  It  is  intended  that  the 
results  of  this  study  will  aid  the  aircraft  designer  in  the 
development  of  a  user  interface  for  the  F/FB/EF-111  aircraft. 

A  major  issue,  associated  with  the  implementation  of  voice 
warnings,  is  whether  or  not  the  warning  messages  offer  an 
advantage  over  the  present  tone  warning  messages.  While  some 
prior  research  results  have  indicated  that  response  to  voice 
warnings  can  be  more  advantageous  with  respect  to  speed 
(Kemmerl  ing  or.  al.,  1969),  others  have  suggested  that  no 
difference  in  response  time  can  be  derived  (Bates  &  Bates. 

1966).  Since  the  introduction  of  voice  warnings  may  not  result 
in  any  significant  increase  in  speed  or  accuracy  of  operator 
performance,  an  evaluation  is  necessary  to  determine  the  relative 
merits  of  voice  and  whether  a  costly  mechanization  process,  both 
in  terms  of  money  and  computer  memory,  is  warranted.  A  secondary 
objective  of  this  report  will  focus  on  past  research  in  the  area 
of  voice  versus  tone  message  warning  comparisons,  and  address  its 
relevance  to  the  F/FB/EF-111  interface. 

The  objective  of  the  present  study,  which  took  place  at 
Aeronautical  Systems  Division’^;  (ASD)  Crew  Station  Design 
Facility  (CSDF) ,  was  to  perform  an  evaluation  of  pilot  accuracy 
and  response  time  performance  at  a  function  of  two  small  sets  of 
aircraft  cockpit  aural  warning  signals:  Tone  messages  versus 
voice  messages.  The  performance  characteristics  were  evaluated 
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independent  of  other  relevant  factors  associated  with  the 
messages.  The  evaluation  does  not  address  such  factors  as  the 
number  of  tones  versus  the  number  of  voice  warnings,  the 
oritleality  of  the  messages,  the  prioritization  of  the  responses, 
pitch,  amplitude,  frequency,  etc...  The  study  does,  however, 
examine  the  effects  of  task  loading  and  background  communication 
(on  the  subject's  response).  Task  loading  is  manipulated  by 
increasing  the  difficulty  of  the  flying  task,  while  background 
communication  introduces  representative  conversation,  into  the 
auditory  channel,  which  is  not  critical  to  the  pilot. 

Considering  the  scope  of  this  effort,  a  possible  follow-on  study 
could  examine  the  same  relevant  factors,  as  in  this  study,  using 
larger  sets  of  tone  and  voice  signals. 

From  a  theoretical  perspective,  an  operator’s  response  to  a 
tone  warning  should  involve  behavioral  and  cognitive  activities 
comprised  of  several  stages  of  human  information  processing. 

These  stages  can  be  simplistically  described  as  the  operator’s 
ability  to  detect,  acknowledge,  and  identify  a  warning.  This  is 
followed  by  a  decision  and  the  initiation  of  the  proper  response 
activities.  The  same  should  be  true  when  the  operator  responds 
to  a  voice  warning.  In  support  of  this  logic,  certain 
assumptions  were  made  in  the  study  which  would  allow  for  equal 
chance  of  identification  between  tone  and  voice  warnings  while 
allowing  for  variability  in  the  operator's  decision  and  response 
activities.  Some  of  these  assumptions  are  as  follows.;  (1)  the 
number  of  warnings  to  be  memorized  by  the  operator  should  be  kept 
low;  (2)  the  semantic  and  physical  featural  distinctions  between 
the  warning  messages  (tone  and  voice)  should  be  significant;  (3) 
the  subjects  should  receive  a  sufficient  amount  of  training  in 
responding  to  the  warnings;  and  (4)  the  warnings  should  occur 
frequently  enough  to  keep  the  subjects  in  a  motivated  state  and 
supplement  the  learning  behavior.  This  list  should  not,  by  any 
means,  be  considered  complete. 
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METHOD 


SUBJECTS 

Twelve  subjects,  who  volunteered  tor  the  experiment,  wirt 
Wright-Patterson  APB  employees  with  no  previous  f  ly inf  «xp*rl*nae. 
The  subjects  verbally  raportad  corractod- to-normal  vision,  and  no 
auditory  akill  daf ioianciaa.  Prior  to  tha  data  collaction 
segments,  all  12  aubjacta  war*  allowed  aufficiant  practice  flying 
a  Terrain  Following  Radar  (TFR)  miaaion  in  tha  F-10  aimulator. 

WARNING  MESSAGES 

Voice  Warning  Messages.  Four  diatinct  voice  warning  meaaagaa 
(from  a  physical  and  aamantic  faatural  perspective)  ware  selected 
to  represent  specific  aircraft  malfunctions,  which  may  be 
corrected  by  pressing  tha  appropriate  switch  on  tha  left  Multi 
Function  Display  (MFD)  of  the  F-16  cockpit  simulator.  A  female 
employee  of  the  Crew  Station  Design  Facility  recorded  the  voice 
messages  on  an  AMIGA  micro  computer. 

The  following  is  a  list  of  the  four  voice  warning  messages 
and  their  appropriate  responses: 


WARNING 

RESPONSE 

1 .  COMPUTER 

RECYCLE 

2.  ELECTRICAL 

BATTERY 

3.  HYDRAULICS 

PRESSURIZE 

4.  OIL 

VENTILATE 

The  AMIGA  used  a  high  speed  voice  digitizer,  called  Future 
Sounds,  with  a  sampling  rate  of  10,000  samples  per  second,  to 
convert  the  messages  from  analog  to  digital  format.  The  AMIGA 
was  thereafter  connected  to  the  main  frame  computers  using  an  RS - 
232  interface. 
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ISM  Warning  UtmUf.  Pour  distinct  ton*  warning  message#  were 
selected  to  represent  specific  aircraft  malfunction*.  Juat  a a 
for  responding  to  th*  voice  warning  messagos,  responding  to  the 
ton*  warning#  also  required  pressing  the  appropriate  awltch  on 
the  left  MFD  of  th*  F-lfl  cockpit  aimulator.  Th*  tone*  were 
generated  by  a  Simulation  Engineering  Laboratories  (SSL)  Gould 
aeries  32/7780  and  32/8780  mainframe  computers  and  transmitted  to 
the  pilots’  headaet  through  the  aama  channel  as  th*  voice  messages. 


The  following  is  a  list  of  th*  four  tone  warnings: 


BMS£ 


1.  Continuous  700  Hs 

2.  Intermittent  1400  Hs 

(200  ms  *  on  * / 100  ms  *off*/ 
600  ms  ‘on’) 

3.  Intermittent  2100  He 

(800  ms  *on’/100  ms  "off) 

4.  Intermittent  2800  Hz 

(200  ms  ’on'/ 100  ms  *off) 


RECYCLE 


BATTERY 

PRESSURIZE 

VENTILATE 


APPARATUS 


Facility.  The  study  was  conducted  at  th*  Crew  Station  Design 
Facility  (CSDF)  ,  a  U.S.  Air  Force  simulation  facility  located  at 
Aeronautical  Systems  Division  (ASD)  ,  Wright  Patterson  AKB  (shown 
in  Figure  1).  The  CSDF  government  personnel  a.'e  assigned  by  the 
Human  Factors  Branch  of  th*  Directorate  of  Support  Systems 
Engineering  (ENE) .  The  facility  is  used  to  conduct  human 
engineering  and  system  design  mechanization  studies  in  support  of 
a  variety  of  System  Program  Offices  (3P0) . 
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Simulator.  Sinoe  the  construction  of  ths  F~ 111  simulator  was  not 
yet  aomploted  at  ths  tims  of  this  study,  ths  available  F- 16 
simulator  was  usad  instead.  This  simulator  was  developed  using  a 
salvaged  single  seat  F-16  cockpit,  truncated  An  front  of  the 
forward  portion  of  the  windscreen,  and  approximately  5?  inches 
behind  the  canopy  lines.  The  F-16  cockpit  simulator  is  comprised 
of  an  all  digital  design  which  includes  two  4X4  inch  Multi 
Function  Displays  (MFD),  a  Wide  Field  of  View  paste*  video  Head- 
Up  Display  (HUD).  Hands  on  Stick  and  Throttle  (HOSAT)  controls, 
the  LANTIRN  avionics  suite,  and  other  actual  systems  found  on' the 
F-16  C/D  aircraft. 

Computer  Complex.  The  simulator,  shown  in  Figure  2,  is 
connected  to  a  series  of  large  and  small  computer  systems.  This 
computer  complex  includes  five  Gould  series  32/7780,  one  Gould 
concept  32/8780,  two  PDP  11/34,  three  PDP  11/35,  and  two  Silicon 
Graphics  Iris  2400  Computer  Aided  Design  (CAD)  stations. 

Visual  Systems.  The  out-the- window  visual  scene  was  provided  by 
using  a  computer  generated  Night  Visual  System  along  with  a  SMK 
23  terrain  model,  and  was  shown  to  the  pilots  on  the  Wide  Angle 
Collimating  window.  The  simulated  LANTIRN  symbology  was 
presented  on  the  HUD,  using  a  Vector  General  symbol  generator  to 
display  the  caligraphic  symbology,  and  a  PDP  11/34  computer  to 
map  and  control  the  HUD's  position.  The  Gould  mainframe 
computers  transmitted  the  flight  parameters  to  the  PDP  in  order 
to  position  the  stroke  symbology  within  the  raster  video  scene, 
so  the  pilots  could  use  the  Integrated  Control  Panel  and  the  HUD 
embedded  symbology  to  fly  the  simulator. 

Experimenter's  Console.  The  experimenter’s  console  is  located 
approximately  ten  feet  away  from  the  simulator.  It  includes  a 
complete  intercom  system,  together  with  communication  to  and  from 
the  pilot  inside  the  simulator.  The  console's  displays  duplicate 
the  pilot's  visual,  HUD,  Data  Entry  Display,  and  MFDs ,  and  are 
used  by  the  experimenter  to  observe  and  monitor  the  pilot's 


performance.  Furthermore,  the  console's  controls  permit  the 
experimenter  to  start,  stop,  and  reset  the  simulation  at  any 
time . 

Audio  Systems.  The  voico  messages  were  subjectively  judged  by 
the  authors  to  be  equally  loud  to  each  other,  and  to  the  four 
tones.  Background  communication  was  simulated  by  an  audio  tape 
which  was  replayed  throughout  selected  missions  of  the  experiment, 
on  a  Panasonic  Technics  Panasonic  tape  player  (mode?  number  RS- 
263AUS)  ,  and  transmitted,  through  the  intercom  channel,  to  the 
pilot’s  headset  (an  ASTROCOM  model  number  20680  with  MX-2508/A/C 
pads . 


PROCEDURE 

Subjects  were  trained  to  perform  a  dual  task  type  of 
experiment.  One  task  involved  steering  the  aircraft  and 
ensuring  it  did  not  deviate  from  a  set  altitude.  A  second 
task  required  the  pilots  to  manually  respond  to  a  series  of  tone 
and  voice  warning  messages. 

The  primary  task  required  each  pilot  to  fly  the  F-16 
simulator  in  a  Terrain  Following  (TF)  mission,  using  the  flight 
path  marker  (the  aircraft  symbol)  on  the  HUD  to  follow  two 

critical  LANTIRN  cues:  The  TFR  box,  and  the  steer  point  bearing 

marker.  An  example  of  the  HUD  configuration  is  shown  in  Figure 
3.  While  the  TFR  box  commanded  pitch  corrections  on  the  part  of 
the  pilot,  the  steer  point  marker  was  more  concerned  with  bank 
improvements.  Pilot  scores  on  the  flying  task  were  computed  by 
measuring  the  vertical  offset  deviation  from  the  center  of  the 
TFR  box.  A  score  of  ten  milliradians  in  absolute  deviation  was 

used  as  a  cutoff  point  for  accepting  or  rejecting  a  pilot’s  data. 

None  of  the  12  pilots  had  to  be  rejected  from  the  study. 

The  flying  task  was  comprised  of  two  different  missions: 
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Easy  and  difficult.  In  flying  the  easy  mission,  the  pilots  had 
to  follow  the  TFR  cues  in  a  straight  direction;  from  point  A  to 
point  B.  The  difficult  mission  was  more  complex,  in  that  the 
pilots  had  nine  different  steer  points  located  at  different 
intervals.  Each  time  the  steer  point  changed  location,  the 
pilots  had  to  command  a  significant  bank  in  order  to  stay  on 
track,  while  keeping  the  flight  path  marker  inside  the  TFR  box. 
The  length  of  each  mission  was  approximately  80  miles,  and  lasted 
about  10  minutes. 


Figure  3.  An  example  of  the  HUD  format  in  TFR  mode. 

The  secondary  task  involved  presenting  the  pilot  with  an 
aural  warning  that  required  an  immediate  response.  Either  a  tone 
or  a  voice  message  was  transmitted  to  the  pilot’s  headset  at  an 
average  of  15  seconds  (with  a  standard  deviation  of  three 
seconds).  Throughout  half  the  missions,  background  communication 
was  presented  by  playing  an  audio  tape  of  a  combat  mission 
recorded  during  the  Vietnam  war,  and  transmitted  to  the  pilot 
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throi  gh  the  headset. 


To  make  the  study  more  motivating,  the  subjects  were  told 
that  they  had  been  recruited  as  part  of  a  test  team  to  evaluate  a 
recently  developed  major  self-diagnostic  and  sel f -corrective  on¬ 
board  computer.  Furthermore,  the  subjects  were  told  that  they 
would  be  helping  in  the  decision  making  process  for  the  selection 
of  the  most  efficient  type  of  warning  system  (voice  versus  tone). 

The  subjects  were  instructed  to  primarily  concentrate  on  the 
flying  task,  while  still  responding  to  the  warnings  as  quickly  as 
possible,  but  without  making  many  errors.  At  an  average  of  15 
seconds,  a  warning  was  repeatedly  heard  on  the  pilot’s  headset 
for  seven  seconds,  or  until  some  type  of  response  was  initiated. 
At  that  time,  the  pilot  was  expected  to  perform  two  responses. 

The  first  response  required  the  pilot  to  verbally  respond  to  the 
warning  by  stating  the  corrective  action,  while  simultaneously 
moving  the  left  hand  off  the  throttle  and  pressing  one  of  the 
four  buttons,  located  on  the  left  MFD,  that  corresponded  with  the 
correct  malfunction.  Figure  4  shows  what  the  MFD  appeared  like 
throughout  the  experiment.  Following  each  response,  whether 
correct  or  incorrect,  the  correct  option  was  highlighted  for  one 
second.  This  highlighting  was  used  as  a  feedback  procedure  to 
aid  the  pilots  in  learning  the  appropriate  responses  to  the 
warning  messages. 

It  should  be  noted  that  the  verbal  response  was  expected  to 
trigger  a  timer  that  measured  vocal  reaction  time. 

Unfortunately,  the  system  did  not  work  properly,  which  caused  the 
measure  to  be  dropped  from  data  reduction  and  analysis. 

Each  subject  received  one  pre-practice  session,  which 
included  ten  minutes  of  system  familiarization,  one  session  of 
practice,  and  one  session  of  data  collection.  The  subjects  were 
allowed  to  take  a  5-10  minute  break  between  each  session.  Both 
the  practice  and  data  collection  sessions  were  comprised  of  four 
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missions,  each  of  ten  minutes  duration,  for  a  total  of  45-50 
minutes  per  session. 


Figure  4.  An  example  of  the  four  responses  on  the  MFD. 


DESIGN 


The  experiment  was  designed  to  compare  pilots’  response 
time  and  response  accuracy  to  either  a  tone  or  a  voice  warning. 
Response  time  was  defined  as  the  time  interval  from  onset  of  the 
warning  message  until  the  pilot  pressed  the  correct  button  on  the 
MFD.  Also  of  interest  to  this  evaluation,  were  the  effects  of 
task  loading  and  background  communication  on  response  time 
performance.  There  were  two  levels  of  task  loading  (easy  versus 
difficult  flying  mission),  and  two  levels  of  background 
communication  (on  versus  off). 

The  missions  that  were  flown  during  the  study  were 
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counterbalanced  in  such  a  way  that  the  order  of  presentation  was 
never  replicated  across  pilots.  However,  the  missions  flown 
during  the  practice  session  were  in  the  same  order  as  the 
missions  flown  during  the  training  session.  Within  each  mission, 
four  tone  and  four  voice  warnings  were  presented,  five  times 
each,  for  a  total  of  4C  warnings.  The  warnings  were  randomly 
selected  from  the  set  of  eight  stimuli  with  the  following 
restrictions : 

(1)  The  exact  same  warning  could  not  appear  consecutively. 

(2)  Warnings  requiring  the  same  response  could  not  be 
presented  consecutively. 

(3)  and  no  more  than  three  warnings  of  the  same  type  (voice  or 
tone)  may  come  on  consecutively. 
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RESULTS 


MEAN  CORRECT  RESPONSE  TIME 

Subjects'  mean  correct  response  time  data  were  analyzed 
using  a  2X2X2  three  way  repeated  measures  analysis  of  variance. 
The  three  independent  variables  were  comprised  of  two  types  of 
warning  messages  (voice  versus  tone),  two  levels  of  flying 
difficulty  (easy  versus  difficult),  and  two  levels  of  background 
communication  (on  versus  off). 

The  analysis  of  variance  resulted  in  statistically 
significant  differences  in  the  main  effects  for  flying 
difficulty,  F(1 ,11)*7.53,  £=0.01,  and  background  communication, 

F ( 1 , 10  =  13. 34,  p.*0.003;  but  not  for  type  of  warning  message, 

£.(  1 , 1 1)  =0.09 ,  £*0.7.  The  means  from  the  three  main  effects  of 
flying  difficulty,  background  communication,  and  type  of  warning 
are  respectively  shown  in  Tables  1,  2  and  3. 

An  inspection  of  Table  1  indicates  that,  on  the  average,  the 
subjects  responded  faster  to  the  warning  messages  (both  for 
tones  and  voices  combined)  when  they  were  flying  the  easy  mission 
versus  the  difficult  mission.  These  results  in  turn  translate 
into  a  sensitive  task  loading  effect  that  led  to  higher  levels 
of  workload  when  the  subjects  were  flying  the  more  difficult 
mission . 

The  means  shown  in  Table  2  suggest  that  background 
communication  interfered  with  the  pilots’  abilities  to  process 
failure  warning  messages.  Subjects’  response  times  were  Slower 
when  the  background  communication  tape  was  turned  ON  as  opposed 
to  when  it  was  turned  OFF. 


The  two  means ,  presented  in  Table  3,  indicate  that  the  type 


TABLE  1.  Reaction  time  Dtrfomno  for  flvin*  difficulty. 

LEVEL  OF  FLYING  DIFFICULTY 
DIFFICULT  EASY 

RESPONSE  TIME  (in  aecondo) 

MEAN  2.451  2.221 

STANDARD  DEV.  0.608  0.445 

TABLE  2.  Reaction  time  performance  for  background  communication. 

BACKGROUND  COMMUNICATION 
OFF  ON 

RESPONSE  TIME— (in,  second*) 

MEAN  2.254  2.417 

STANDARD  DEV.  0.543  0.511 

TABLE  3.  Reaction  time  performance  for  type  of  warning. 

TYPE  OF  WARNING 
TONE  VOICE 

RESPONSE  TIME  (in  eeconda) 

MEAN  2.346  2.326 

STANDARD  DEV.  0.576  0.-.7^ 
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of  warning  did  not  have  a  Significant  effect-  on  pilots'  reaction 
time  performance.  The  time  it  took  to  perceive  the  warning  until 
an  appropriate  response  was  initiated,  did  not  differ  whether  the 
message  was  presented  in  a  tone  or  a  voice  format.  These  results 
imply  that  similar  human  information  processing  stages  were 
encountered  when  responding  to  a  tone  or  a  voice  warning. 


M 

o 


o 

UJ 

CO 


•DIFFICULT 


Figure  5.  Mean  correct  response  time  as  a  function  of  difficulty 
and  background  communication.. 


Of  all  the  interactions,  only  one  two-way,  involving  mean 
correct  response  time  as  a  function  of  the  two  levels  of 
difficulty  and  the  two  levels  of  background  communication,  was 
statistically  significant,  F  ( 1 , 1 1)  =  10.96  ,  p.=  0.007.  An  inspection 

of  the  means,  presented  in  Figure  5,  suggests  that  while  there 
was  a  difference  in  pilots'  response  time  performance  between  the 
easy  and  difficult  missions,  background  communication  had  more  of 
an  interference  effect  during  the  easy  mission  than  it  did  during 
the  difficult  mission.  The  analysis  of  the  simple  main  effects 
for  the  independent  variable,  background  communication,  resulted 
in  statistically  significant  differences  in  response  time 
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TABLE  4. 


AHOVA  table  for  response  time  ptrfoni>*ag.». 


BE 

S3. 

E. 

R 

AXBXC 

l 

0. 127 

3.32 

0. 10 

AXB 

1 

>.035 

3.86 

0.08 

AXC 

l 

0.068 

1.08 

0.30 

BXC 

l 

0.168 

10.96 

0.007  * 

A 

l 

0.01C 

o 

o 

o 

0.70 

B 

l 

0.637 

13.34 

0.004  * 

C 

l 

1.265 

7.53 

0.01  * 

AXBXCXS 

li 

0.421 

AXBXS 

n 

0.100 

AXCXS 

1 1 

0.603 

BXCXS 

u 

0.  If8 

AXS 

li 

1 .  169 

BXS 

li 

0.525 

CXS 

li 

1.849 

S 

li 

41.365 

*  Results 

were  significant 

A=TYPE  OF  WARNING 

(VOICE  VERSUS  TOME) 
B*BACKGROUND  COMMUNICATION 
C-FLYING  DIFFICULTY 
SsSUBJECTS 


performance  during  the  easy  mission,  F(l,l)  =  25.7,  £=0,0004,  but 
not  during  the  difficult  mission,  £(1 , 1)=2. 18,  £>0.1.  The 
results  of  this  two-way  interaction  might  suggest  that,  in  a  high 
workload  environment,  pilot3*  performance  is  deteriorated  to  the 
extent  that  additional  task  loading  (in  the  means  of  background 
communication)  does  not  further  affect  performance. 
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Non*  of  th*  oth*r  two  or  thr**  way  interaction*  w*r*  found 
to  b*  statistical ly  significant.  A  complete  ANOVA  tabi*  ia 
shown  in  Tabl*  4. 

MEAN  PERCENTAGE  OF  CORRECT  RESPONSES 

Th*  aubj*cta'  m*an  p*rc*nt  correct  r*apona*a  war*  alao 
analysed ,  a a  a  function  of  two  typaa  of  warning  (voic*  v*rau a 
ton*),  two  levels  of  flying  difficulty  (*aay  v*raua  difficult), 
and  two  levels  of  background  communication  (on  v*raua  off),  fn  a 
2X2X2  r*p*at*d  m*aaur*a  analyaia  of  varianc*. 


TABLE  5.  Sublets’  m*an  p*rc*nt  accuracy  f  or  tach-._g.f .  thi  Ahr.A.1. 
main  effect*. 


INDEPENDENT  VARIABLE 


TYPE  OF  ti&OIVG 


FLYING  DIFFICULTY 


hSSSk  MEAN  PERCENT  ACCURACY 


TONE 


V0IC4 


DIFFICULT 

EASY 


ON 


BACKGROUND  COMMUNICATION 


OFF 


00 


08 


07 


06 


90 


07 


Neither  the  interactions  (two  and  three  ways),  nor  the  mair 
effect  analyses  resulted  in  any  statistically  significant 
differences.  It  can  be  seen  by  examining  the  main  effect  means 


shown  in  Table  S,  that  tha  subjects  wars  fairly  acourata  in 
responding  * o  tha  warning  maaaagaa  in  all  tha  taatad  dimensions; 
at  no  tima  did  tha  aubjaota  miss  nora  than  four  percent  of  tha 
warnings.  Tha  accuracy  rasults  indicate  that  tha  subjects  did 
conform  with  tha  experimenter's  instructions  requesting  them  to 
respond  as  quickly  as  possible,  but  without  forcing  many  errors. 
Tha  complete  ANOVA  table  is  shown  in  Table  0. 


table  o.  AMAYA  ttblf  lac  aifcgmJt  ssolms!  BaiAormnsi- 


BE. 

SS. 

E 

L 

AXBXC 

l 

1.78 

0.  13 

0.73 

AXB 

l 

18.88 

0.78 

0.40 

AXC 

l 

2.80 

0.31 

0.59 

BXC 

l 

4.28 

0.  14 

0.71 

A 

l 

78.82 

1.48 

0.25 

B 

l 

10.21 

0.48 

0.50 

C 

l 

50.86 

3.90 

0.07 

AXBXC XS 

ll 

156.21 

AXBXS 

ll 

272.28 

AXCXS 

ll 

101.01 

BXCXS 

ll 

327.90 

AXS 

u 

570.24 

BXS 

ll 

233.33 

CXS 

ll 

142.78 

S 

ll 

391.11 

a»type  of  warming 

(VOICE  VERSUS  TONE) 
B*BACKGROUND  communication 
C-FLYING  DIFFICULTY 
SsSUBJECTS 


OOKGLUBIOM 


The  result*  of  the  present  study  have  significant 
implications  on  the  future  design  und  developmont  of  en  aircraft 
warning  system.  The  following  paragraphs  discuss  the  major  key 
issues  that  should  be  considered  by  designers. 

If  the  aircraft  warning  system  is  limited  to  no  more  than 
four  warning  messages,  then  the  speed  and  accuracy  of  responding 
to  a  warning  message  do  not  favor  one  mode  of  presentation  over 
another  (voice  or  tone).  In  this  case,  it  is  more  advantageous 
(both  in  terms  of  monetary  and  computer  resources  expenditures) 
to  install  a  less  costly  Tone  Warning  System  (TWS) ,  as  opposed  to 
installing  a  more  expensive  Voice  Warning  System  (VWS). 

Based  on  a  compilation  of  information  disaussed  in  this  and 
other  basic  (Deatherage,  1072)  and  applied  (MIL-STD- 1472)  reports 
and  documents,  it  is  be  concluded  that  if  a  warning  system  may 
ever  contain  a  large  number  of  messages  (five  or  more),  as  does 
the  F/FB/EF-111  aircraft,  then  the  implementation  of  a  VWS  would 
make  it  easier  and  faster  for  the  crewmembers  to  interpret  the 
warnings,  process  the  necessary  information,  decide  upon  the 
appropriate  response,  and  initiate  the  correct  response 
activities . 

Despite  the  present  conclusions  on  the  tone  versus  VWS, 
it  should  be  noted  that,  when  using  large  sets  of  warning 
messages,  the  most  significant  advantage  of  a  VWS  is  not 
necessarily  related  to  the  speed  or  accuracy  of  responding,  but 
rather  that  it  provides  the  crewmember  with  the  oapabi  lity  of 
being  able  to  evaluate  the  reported  failure,  without  scanning 
back  into  the  cockpit.  A  1960  study,  performed  at  the  CSDF  by 
Kemmerling  et  al.,  examined  the  effects  of  F- 111  pilots’  visual 
scanning  patterns  as  a  function  of  tone  versus  voice  warning 
messages.  The  results  of  video  analyses  on  visual  scan  patterns 


indicated  that  pilots  who  racaivad  tons  warnings  ware  forced  to 
cross-chock  the  annunciaton  panel  even  whan  they  encountered  a 
non-critical  failure.  However,  these  same  pilots  were  able  to 
process  the  voice  warnings,  decide  on  their  level  of  criticality 
and.  if  necessary,  elect  to  ignore  them  until  they  reached  a  less 
demanding  portion  of  the  mission. 

One  of  the  major  criticisms  of  VWS,  made  by  individuals  with 
operational  experience,  deals  with  the  interference  effect  it  can 
have  on  other  audio  transmissions  inside  the  cockpit.  Thornburn 
(1071)  discussed  the  development  of  an  override  option  and  combat 
mode  blocking  mechanism  as  two  methods  for  dealing  with  this 
interference  effect.  The  override  option  allows  the  crewmember 
to  silence  the  voice  message  unless  there  is  another  message  that 
needs  to  be  acknowledge.  The  combat  mode  restricts  all  messages 
from  being  presented  to  the  pilot,  unless  they  are  classified  as 
critical  (such  as  a  ground  collision  advisory  system), 
specifically  during  high  workload  demanding  portions  of  the 
mission . 

Other  specific  elements  that  should  be  considered  throughout 
speech  display  design  are  compiled  from  a  paper  by  Werkowitz 
(1970)  and  listed  below: 

1.  What  specific  voice  messages  best  represent  the  user 
population's  definitions  7 

2.  Should  VWS  be  required  to  use  a  preliminary  alerting 
tone  as  required  in  MIL-STD- 1 472 ,  or  can  the  voice  message  be 
reliably  detected  without  it  7 

3.  Should  the  voice  message  be  repeated  to  the  pilot  until 
a  corrective  response  is  completed  or  a  shut-off  switch  is 
depressed,  or  should  the  VWS  repeat  the  message  a  specified 
number  of  times  (such  as  two  or  three  times)  7 
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4.  Should  the  intensity  of  the  messages  be  20  dB  on  top  of 
a  baseline  background  noise  level,  or  should  it  be  related  to  the 
change  in  background  noise  level  ? 

5.  Are  the  voice  messages  contained  in  the  VWS  distinctive 
and  intelligible  ? 

6.  Should  the  voices  be  recorded  by  a  male,  a  female,  or  a 
machine  ? 


7.  Should  the  message  inform  the  crewmember  of  what  is 
wrong,  or  should  it  command  for  a  specific  response  ? 

In  conclusion,  the  end  result  of  the  present  report  was  to 
set  the  stage  for  follow-on  studies  that  could  possibly  influence 
the  development  of  a  VWS.  A  follow-on  study,  to  be  performed  at 
the  CSDF,  will  examine  three  of  the  above  mentioned  variables. 
Most  importantly,  it  will  evaluate  the  proposed  voice  massages  in 
terms  of  comprehension  and  distinction.  Furthermore,  the  study 
will  examine  pilots'  performance  as  a  function  of  preliminary 
alerting  bell  (with  and  without  the  bell),  and  also  the  number  of 
times  a  warning  message  is  presented  (two  versus  until  a  response 
i s  made) . 
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